A Double-Penalized Estimator to Combat Separation and Multicollinearity in Logistic Regression
نویسندگان
چکیده
When developing prediction models for small or sparse binary data with many highly correlated covariates, logistic regression often encounters separation multicollinearity problems, resulting serious bias and even the nonexistence of standard maximum likelihood estimates. The combination makes task more difficult, a few studies addressed simultaneously. In this paper, we propose double-penalized method called lFRE to combat in regression. combines logF-type penalty ridge penalty. results indicate that compared other methods, can not only effectively remove from predicted probabilities but also provide minimum mean squared error. Aside that, real dataset is employed test performance algorithm several existing methods. result shows has strong competitiveness them be used as an alternative solve problems.
منابع مشابه
A Solution to Separation and Multicollinearity in Multiple Logistic Regression.
In dementia screening tests, item selection for shortening an existing screening test can be achieved using multiple logistic regression. However, maximum likelihood estimates for such logistic regression models often experience serious bias or even non-existence because of separation and multicollinearity problems resulting from a large number of highly correlated items. Firth (1993, Biometrik...
متن کاملAsymptotic properties of a double penalized maximum likelihood estimator in logistic regression
Maximum likelihood estimates in logistic regression may encounter serious bias or even non-existence with many covariates or with highly correlated covariates. In this paper, we show that a double penalized maximum likelihood estimator is asymptotically consistent in large samples. r 2007 Elsevier B.V. All rights reserved.
متن کاملWeighted Ridge MM-Estimator in Robust Ridge Regression with Multicollinearity
This study is about the development of a robust ridge regression estimator. It is based on weighted ridge MM-estimator (WRMM) and is believed to have potentials in remedying the problems of multicollinearity. The proposed method has been compared with several existing estimators, namely ordinary least squares (OLS), robust regression based on MM estimator, ridge regression (RIDGE), weighted rid...
متن کاملPenalized Logistic Regression in Case-Control Studies
Likelihood-based inference of odds ratios in logistic regression models is problematic for small samples. For example, maximum-likelihood estimators may be seriously biased or even non-existent due to separation. Firth proposed a penalized likelihood approach which avoids these problems. However, his approach is based on a prospective sampling design and its application to case-control data has...
متن کاملA penalized logistic regression approach to detection based phone classification
Recently, we have proposed a detection-based speech recognizer which has two main components: a bank of phonetic feature detectors implemented with hidden Markov models (HMMs), and an event merger. Each detector generates a score that pertains to some phonetic features, e.g. voicing. The merger combines all these scores to generate phone labels. The parameters of the detectors and the merger ca...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Mathematics
سال: 2022
ISSN: ['2227-7390']
DOI: https://doi.org/10.3390/math10203824